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Introducing the Touch Panel 


By Mark Fihn 


Veritas et Visus is pleased to introduce the Touch Panel -- a newsletter about the technologies and products that 
help people interact with their electronic devices by way of touch. Veritas et Visus is Latin for “Truth and Vision”; 
our goal is provide insightful and relevant information about the displays industry through a series of specialty 
newsletters. We intend to provide timely and informative coverage of various aspects of the displays industry in 
non-technical English, at a price point that is affordable to all interested parties. 


Up until some point in time, perhaps in the late 1990s, the primary output device between human beings and our 
computers was the printer. It’s really not so long ago, that most users actually printed out the vast majority of their 
e-mails. As the volume of information increase, while 
display performance improved, the display replaced the 
printer as the primary output device. Although predictions 
of a “paper-less society” have yet to materialize -- printers Output 
are still big sellers — there can be no doubt that the display Device 
has become the primary output device. 
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Today, the primary input device between human beings and 

our computers is the keyboard. What’s exciting for display Primary 
technologists is the possibility that in the future, the display 
may also become our primary input device. As touch and 
handwriting recognition technologies continue to improve, 
and as display performance improves, it’s natural for many 
applications to make inputs directly on the screen itself. 
For some applications — PDAs, for example, the screen is already the primary input device. The promise of Tablet 
PCs (although yet unrealized), adds credibility to the possibility of touchscreens becoming a primary input device. 
Even for very large screens, the rising popularity of interactive whiteboards is promising for touchscreen 
technologies. 
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Publisher, Mark Fihn, most recently worked for three years at the market research firm DisplaySearch. He 
additionally participated for 15 years in computer system and LCD-related procurement at Texas Instruments and 
Dell Computer. He has been active in many display-related areas, most specifically in publicly championing 
industry-wide adoption of high-resolution displays, notebook LCD standardization, and video sub-system 
integration. He has been an active supporter and lecturer at the DisplayMasters degree program in the UK, 
contributing course lectureships at Cambridge University, Dundee University, and Nottingham Trent University. 


Editor, Phillip Hill, worked for six years at the Institute of Physics in the UK where he edited Opto & Laser 
Europe and championed the need for a magazine and newsletter in the displays field. He launched and edited 
Displays Europe in collaboration with the Society for Information Display in 2001. Phillip spent most of his 
journalistic career in France where he worked as the Paris correspondent for a variety of US and European B2B and 
science & technology publications. Phillip was educated in England culminating in an Honors Degree Program in 
Physics from the University of Sussex. 


We plan to publish 10 issues of the Touch Panel annually. We encourage an open industry dialog and seek 
feedback from our readers. We also encourage readers to contribute news and views about their experiences with 
touch technologies and emerging touch-related markets. With a background in display technologies and display- 
related journalism, we hope to offer a combination of insight and inquisitiveness that will delight out readers. 
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News from around the world 


Compiled by Phillip Hill 


TMD announces “‘world’s first’ TFT-LCD with light-pen input 
Toshiba Matsushita Display Technology has announced the development of a low-temperature polysilicon (LTPS) 
TFT LCD prototype display with a novel light-pen input that enables users to hand-write freely onto the display 
surface. TMD exhibited this new technology CEATEC Japan 2005 in October and FPD International 2005 in 
Yokohama, Japan. One of TMD's strategic efforts has been to take advantage of the characteristics of LTPS 
technology to develop system-on-glass (SOG) products. In April 2003, TMD announced the world's first input- 
display that could scan images placed directly onto the surface of the display. The new light-pen input is another 
step in the development of SOG technology. The new prototype has a photo sensor and signal-processing LSI that 
enable characters, graphics and line art to be written directly onto the LCD glass. This differs from today's existing 
methods of incorporating input into display systems, which add additional devices, such as touch panels, and their 
associated costs. The light-pen approach does not degrade brightness or contrast, and, since the input function is 
integrated directly into the display, the overall package is thinner, lighter, and more compact, as well as having high 
reliability, the company says. The new display 
incorporates higher-resolution LTPS technology and 
ae hie pE 4 ve alll faster switching speeds. Through improvement of 
signal, and rapid signal processing, the display 
delivers remarkably quick encoding of input 
information. The display's built-in photo-sensors, 
when combined with the light pen, enable direct input 
of handwritten graphics, text, and images. TMD 
believes that the development of this light-pen display 
will fuel the development of various kinds of 
applications and products for business and other 
markets. The display's specifications are 3.5 inch 
diagonal, format 240 x 320 pixels, 260K colors. 


www.tmdisplay.com 
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TMD develops LTPS TFT LCD with finger shadow sensing 

Toshiba Matsushita Display Technology (TMD) has developed a prototype low-temperature polysilicon (LTPS) 
TFT LCD, where touching icons and buttons on the screen directly with a finger activates their functions. 
Achieving high-speed switching, greater photo sensor sensitivity, and precise signal processing, the LCD 
incorporates advanced finger shadow sensing. As in the company's previous input display products, the new LCD 
adopts the proprietary SOG (system-on- glass) technology, while photo sensors and signal processing functions are 
integrated on the LCD's glass, allowing for applications on mobile devices. Display size is 2.4 inch. The prototype 
was displayed at CEATEC Japan 2005 in October. 


Synaptics incorporates TouchPad module into Medion notebook 
Synaptics, a developer of interface solutions for mobile computing, has announced the first implementation of the 
Dual Mode TouchPad module and a new design for its ScrollRing interface in a remote control, both shipping with 
the new Medion MD 96500 notebook computer. The custom-designed Dual Mode TouchPad transforms the 
Synaptics laptop TouchPad from a navigation device to a media control center with the touch of a button. In default 
navigation mode, the TouchPad provides cursor navigation. When the dual mode button is engaged blue LEDs 
illuminate application icons and controls on the pad. The illuminated interface offers multimedia controls, including 
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volume, play/pause, stop, previous, next and mute, and also application launch buttons for Internet Explorer, 
search, mail, and media player. To switch from cursor mode to media mode, users tap on the upper right tap zone 
on the TouchPad module. The Medion MD96500 also ships with a remote control, allowing users to remotely 
access television or multimedia files, such as music and movies. Synaptics’ ScrollRing serves as the primary 
interface for the remote control offering intuitive on-screen navigation. The Medion MD 96500 notebook computer 
is currently available in retail stores in Europe. 


NEC Display Solutions of America brings out latest AccuSync line 
NEC Display Solutions of America has announced the availability of the new 
AccuSync line of touch screen LCD monitors. The four new NEC touch- 
enabled displays use the 15 inch AccuSync LCD 52V and the 17 inch 
AccuSync LCD 72V monitors with a choice of either capacitive or resistive 
touch screen technology to deliver interactive touch to markets such as retail 
point-of-sale, entertainment, hospitality, kiosks, medical, industrial, education 
and transportation. The monitors use 3M’s ClearTek capacitive touch screens 
incorporating 3M’s MicroTouch resistive touch screen technology and offer 
multiple input stimuli, including a finger, gloved hand or pen stylus. The NEC 
AccuSync technology provides for uninterrupted display of full-motion video 
with response times of 25 ms or less. www.necdisplay.com/protectyourimage 





UPEK showcases latest biometric products 

UPEK, a supplier of biometric fingerprint security products and services, showcased a range of silicon biometric 
fingerprint-secured products November 15-17 in Paris, France. Offering demonstrations ranging from biometrics- 
secured notebook computers and portable hard drives to access control and handheld fingerprint matching 
terminals, UPEK's exhibition also included the first public showing of an XID Technology access control device 
that combines UPEK's fingerprint authentication subsystem with XID's facial recognition for multi-biometric 
authentication. Additional demonstrations included the Lenovo ThinkPad notebook PC, NEC Computers Versa 
notebook PC, LaCie SAFE Mobile Hard Drive, and SanDisk Cruzer Profile USB flash drive, all equipped with 
UPEK TouchStrip fingerprint security subsystems. In addition, UPEK displayed a Cherry FingerTip ID Board 
keyboard, Tricubes 1020 secure handheld computer, and the Precise Biometrics 200MC combination fingerprint 
and smart card reader, all with integrated UPEK TouchChip fingerprint area sensors. 


3M integrates touch technology into 40 inch NEC monitor 

3M Touch Systems has announced the availability of its touchscreen technology, Dispersive Signal Technology 
(DST). US-based Richardson Electronics’ Pixelink Division will offer an integrated NEC MultiSync LCD 4010 40 
inch TFT touch-screen monitor incorporating the 3M MicroTouch DST touch screen and controller, which is 
available for sale and shipment from Pixelink Corporation. The 40 inch touch screen is the first in a planned 
product range of large-format (over 30 inch) products. Key application segments include conference rooms, 
education, financial exchange, retail signage and billboards, transportation, and other indoor venues such as casino 
hospitality, trade shows, clubs, and restaurants. Unlike other solutions that recognize touch by the interruption of 
electrical fields, acoustic waves, optical fields, or infrared light, DST recognizes touch by interpreting bending 
waves created in the overlay substrate via the impact of a touch. This approach helps eliminate performance issues 
associated with on-screen contaminants and surface scratches, while offering enhanced palm rejection. Future 
commercial implementations of DST touch screens will result from 3M's work with Richardson's Pixelink Division 
and other specialized display integrators. 
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HoloTouch selected for 
FastTrack program 

HoloTouch has been accepted into the 
Connecticut Technology Council’s (CTC) 
mentoring and development program for 
promising high-technology start-ups. The 
FastTrack program, CTC’s innovation 
business accelerator is an advisory and 
matching program that helps connect start- 
ups possessing innovative ideas that have the 
potential for rapid growth and market 
potential to proceed quickly to gain seed- 
stage capital. A recent iteration of 
HoloTouch’s technology, BeamOne, is seen 
by a standard PC as a keyboard, enabling an 
Operator to enter commands by simply 
passing a finger through holographic images 
floating in the air five inches in front of the 
device. www.holotouch.com 
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Interlink Electronics introduces 
interactive signature terminal 

Interlink Electronics, a developer of intuitive interface 
technologies and solutions for business and home 
applications, has announced availability of the ePad XL 
interactive signature terminal. Created to capture, bind 
and verify signatures, ATM card data and interactive 
customer information, the ePad XL terminal is designed 
for deployment in banks, hotels, car rental counters, 
cellular service offices and other customer-facing 
applications. In addition to capturing and encrypting 
personal signatures, ePad XL's LCD touch screen displays 
text and graphic content for customer review and 
interaction. ePad XL is fully integrated with Interlink's 
family of ePad electronic signature capture devices and its 
IntegriSign Signature Software Suite. ePad XL was 
introduced at the BAI Retail Delivery Conference & Expo 
held in Orlando, Florida, November 15-18. ePad XL is an 
interactive data terminal that captures handwritten 
signatures, ATM card data and other interactive customer 
responses. Its 5.7 inch LCD touch screen has a resolution 
of 320 x 240 dpi and is pressure sensitive, capturing 
signatures with a resolution of 903 x 1238 points per inch 
(ppi) and a data rate of 200 reports per second. ePad XL 
employs secure terminal technology including secure key 
injection, tamper response, dedicated security processor, 
firmware authentication, file authentication, PIN 
encryption, master/session key, DUKPT, single and triple 
DES 64 and 128 bit keys. Signature data encryption is an 
option to the standard model. The IntegriSign Signature 
Software Suite is a secure, fully-integrated signature 
platform that gives clients the tools to capture, bind and 
verify electronic signatures easily and quickly across 
multiple application environments. Both turnkey and 
high-level developer toolkits are available and a dedicated 
engineering team supports its integration. IntegriSign is 
also fully integrated with the ENJOA_ eNotarization 
platform of the National Notary Association and with 
leading banking, financial and enterprise software 
platforms. www.interlinkelectronics.com 
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Elo TouchSystems adds 32 inch overlay 

Responding to the increasing demand for large displays, Elo TouchSystems has added a new 32 inch IntelliTouch 
surface wave touchscreen overlay to its line-up. The new screen joins the company’s 30 inch IntelliTouch product 
and is available now for applications including point of information (POI) kiosk displays, interactive digital signage 
in locations such as airports and retail locations, gaming machines, centralized monitoring within the medical and 
industrial markets and large displays in conference rooms and exhibition centers. The company says that the 
touchscreen has 92% light transmission, as it is composed of pure glass without any plastic or metallic coatings, as 
well as offering a 4095 x 4095 touch-point resolution for smaller touch targets. Source: Display Monitor. 


http://www.elotouch.co.uk 


FogScreen adds interactive touch system for PC applications 

Finnish company FogScreen has added an interactive touch system that can control a PC to its projection screen 
technology (for full details of the technology see Veritas et Visus 3rd Dimension Vol I No 1, June 2005). Called the 
FogScreen Interactive, the system was launched at InfoComm and at the European Collaborative for Science, 
Industry and Technology Exhibitions (ECSITE) 2005 in 
the company’s native Finland. The airborne projection 
screen is based on a “floating? layer of dry fog 
controlled by laminar airflow on which is projected a 59 
x 79 inch image using a regular video projector. When a 
user touches an image on the FogScreen Interactive with 
their hand, the system is designed to forward the co- 
ordinates to a PC where the touch acts as a double-click 
action, much in the same way as a graphics tablet pen or 
a mouse. The system uses a Class 1 laser scanner to 
produce a grid about 2 mm in front of the screen’s 
surface. The system works with Windows XP and 
potential applications include marketing, POS, 
exhibitions and gaming. Source: Display Monitor. 





Methode Electronics and Immersion sign license agreement for TouchSense technology 

Methode Electronics, a manufacturer of electronic component and subsystem devices, and Immersion Corporation, 
a developer and licensor of touch feedback technology, have announced that Methode has licensed a broad range of 
Immersion's TouchSense technology. The agreement provides Methode the opportunity to use the technology to 
offer new, innovative products to automotive OEMs, Tier | suppliers, and non-automotive customers in markets 
such as industrial controls, exercise equipment, marine, and aerospace. Methode's engineering teams will work with 
Immersion's research and development teams to bring Methode rotary control, joystick, touchscreen, and touch 
surface products with programmable touch feedback, known as haptics, to market. These products will provide a 
broad spectrum of touch sensations to help inform the user, reduce distraction in the automobile, and improve the 
precision and speed of control in a variety of applications. www.methode.com 


Medion and Toshiba add AuthenTec fingerprint features to notebooks 
Biometric fingerprint sensors from AuthenTec are being added to Medion's new MD 96500 Notebook PC - 
providing advanced security and easy to use touch-powered features for consumer notebook PC users. Medion is 
embedding the EntréPad 2501A from AuthenTec, which features the company's TruePrint technology, into its new 
MD 96500 notebook computer, designed for the consumer market. AuthenTec's EntréPad 2501A fingerprint sensor 
replaces the need for passwords, allowing authorized users to access their private Internet pages and files by simply 
sliding their finger across the sensor surface. At the same time, the sensor restricts access to the computer and its 
files to only those enrolled. Medion is also tapping the EntréPad 2501A's Power of Touch capabilities to enable 
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users to perform other functions, including fast user switching that enables each individual authorized users to 
simply swipe a finger across the sensor to quickly and automatically bring up their individual desktops and favorite 
applications. For enhanced security, Medion has implemented Pre-Boot-Authentication (PBA). This requires the 
user to authenticate already from BIOS before booting the PC. A simple and single finger swipe will bring the user 
all the way up to his individual Windows Desktop without entering further passwords and user names. Authentic is 
also adding security and password management to Toshiba America Information Systems’ newest notebook 
computer, the Tecra S3. www.authentic.com 


Logitech ioTags allows handwriting in meetings and automatic import 

Logitech has unveiled the Logitech ioTags feature, part of a software update to the 
Logitech i102 Digital Writing System, which allows people to use basic handwritten 
symbols to identify tasks, calendar entries and e-mail as they take notes with digital pen 
and paper during a meeting. When they return to their desk and dock the pen, the marked 
portions of the notes are automatically converted to text and imported into Microsoft 
Outlook or Lotus Notes. Other enhancements to the Logitech i102 software include 
providing users the ability to search digital pen documents using Google Desktop Search, 
and the capability of editing and searching 102 Digital Pen notes imported into Microsoft 
Office OneNote 2003. www.logitechio.com 





Tangent introduces VITA LCD touchscreen for hospitals 
Tangent has announced VITA, an all-in-one LCD PC that integrates a flat panel 17 inch LCD touch screen display 
into a slim chassis that fits ergonomically into any health care practitioner's office or a hospital environment. Data 
entry can be by stylus or by optional touch screen on the display. “Touch screens are being widely adopted as the 
standard display in the health care industry because they are more convenient, interactive, and 
provide a more user-friendly access and communication between healthcare professionals and patients,” said Mike 
Zabaneh, Tangent vice president of marketing. www.tangent.com 


Ethertouch introduces ASIC with 12-channel capability 

Ethertouch Ltd., a fabless semiconductor company focused on next generation capacitance sensing chip technology, 
is introducing the first highly-integrated ASIC with 12-channel capability. The Ethertouch AD7103 40-pin ASIC is 
designed specifically for sensing presence or absence of motion - especially human motion. Ethertouch is targeting 
several large consumer markets for the initial launch, although the 40-pin ASIC offers many features that are useful 
for industrial products and process control applications. The AD7103 e-field (capacitance) sensing technology 
features a multi-channel capacity and is the only 12-channel ASIC available today (3 independent channels with 4 
inputs per channel). The AD7103 achieves 16-bit resolution, which enables measurement down to 4af/rtHz. This 
enables the measurement of very small movements and/or changes even in the presence of large background 
signals. Ethertouch has developed an evaluation kit to demonstrate the capabilities of the ASIC in the desired 
configuration for linear, 2D or 3D applications. The $495 kit contains the ASIC evaluation board, software tools, 
instructions and hardware to develop a prototype for specific applications. www.ethertouch.com 


HitachiSoft releases two new interactive tablets 
HitachiSoft has released two new models in its interactive digital board “DigitalBoard” series (marketed overseas 
as the “StarBoard’’). Sales of the “T-17S XL”, a 17 inch liquid crystal tablet model, have started, and it has already 
started shipping worldwide - in Japan, Europe, North America, Asia. The “F-Portable”, or front-portable model, 
which easily attaches to pre-existing whiteboards and blackboards, starts shipping in Japan in September. Like the 
pre-existing T-15XL, it has, in addition to its pendriven interface, eight function buttons, which can be set to 
operate each DigitalBoard software function, facilitating full-screen operation by obviating the need for pull-down 
menus. It also has an output signal jack (RGB jack) which, when using the tablet function and a liquid crystal 
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projector, allows the operator to project on a big screen actions performed manually on the tablet. 
http://hitachisoft.jp/digitalboard/ 


HoloTouch wins two holographic awards 

HoloTouch Inc (ww.holotouch.com) has announced that its BeamOne evaluation 
kit was awarded two Excellence in Holography Awards by the International 
Hologram Manufacturers Association. “Best New Holographic Product of 2005” and 
“Best of 2005” awards were presented to HoloTouch in Shenzhen, China. 
BeamOne’s touchless holographic control technology is the basis for products in the 
gaming, kiosk, lighting, medical and military markets. BeamOne projects 1 inch 
square floating holographic images of its “keys” several inches in front of the 
hardware. A standard PC sees BeamOne as a keyboard. This device is programmable 
and comes with all necessary software and the infrared sensors needed to detect an operator's interaction with its 
floating holographic images as well as free support. Further information about this evaluation kit and its USB, 
serial port and relay output capabilities, as well as detailed specifications, can be obtained by visiting 
www.holodemo.com/store.html, where it can also be ordered. 





Immersion enters into agreement with I-play 

Immersion Corporation, a developer and licensor of touch 
feedback technology, has entered into an agreement with I-play, 
the mobile games company, to add VibeTonz effects to two of its 
most popular games, 2Fast 2Furious and Metal Slug Mobile, for 
Samsung’s SCH-n330 phone. Verizon Wireless is now offering 
2Fast 2Furious for the n330 on its Get It Now service. Using the 
VibeTonz Studio software developer kit, content developers can 
add realistic VibeTonz force feedback effects, like those in video 
and console games, to make mobile games more immersive. The 
VibeTonz System exerts precise control over the phone’s motor to 
produce a wide range of effects - from the staccato of machine gun 
fire and rumble of explosions in Metal Slug Mobile to the engine 
acceleration in 2Fast 2Furious. www.immersion.com 





Polyvision introduces Thunder educational tool 

Poly Vision Corporation has introduced Thunder — a visual communication tool — to the higher education market at 
EduCause, in Orlando, Florida in October. The Thunder system provides the education community with the 
efficiencies of scale created by connecting professors, students and researchers in disparate locations, working on 
the same project, in real time, and sharing the same information. Thunder earned the “Best New Product InfoComm 
2005” designation from industry expert Gary Kayye and is a federation of networked appliances which leverage the 
web as the hub for participation. The user interface is simple and intuitive, providing easily recognizable icons that 
represent familiar tools and actions. In the simplest Thunder mode, participants can create, edit, move, resize and 
delete written content in a variety of formats with the stroke of a stylus or finger. Thunder is used in a way similar 
to the flip chart, with a participant jotting notes and drawings onto a “page” with an electronic pen or finger. 
Multiple pages are projected onto the wall in high resolution, allowing all of the information to remain visible to all 
participants, much like flip chart pages in a non-digital world. www.polyvision.com 


Promethean and Riverdeep collaborate on interactive learning 
Promethean and Riverdeep have joined together to bring interactive learning resources to pre-school and primary 
teaching environments. This new partnership combines Promethean’s interactive whiteboard and associated 
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technology with Riverdeep’s “Destination” series of education software. In addition, Promethean’s ACTIVote 
handheld remote voting pods give teachers the ability to perform real-time assessment and measurement of class 
participation. The combined solution provides fully functional “mouse” capabilities with a simple point-and-click 
Operation to access roll-overs, tool tips and other common features of multi-media content. 


www.prometheanworld.com 


Smart launches new SMART Board interactive whiteboard 

Smart Technologies has announced the launch of the SMART Board 600 series interactive whiteboard. The 600 
series offers larger screen sizes, an easily accessed Help button, a hardware expansion slot and new accessories. 
The 600 series retains all the features of the 500 series the favorite of educators for the last seven years: finger- 
touch control, the SMART Pen Tray and the award-winning whiteboarding software. The 600 series ships with 
SMART Board software 9.1 and immediately replaces the 500 series. The new screen sizes are 77, 64 and 48 
inches, which makes the series suitable for installation in larger classrooms with more students. The SMART Pen 
Tray has been redesigned to hold new ergonomic pens and an eraser and incorporates a Help button and an 
expansion slot. The first expansion accessory 1s a SystemOn module that provides a one-touch start-up of the 
computer, projector and SMART Board interactive whiteboard simultaneously. SMART Board 600 series 
interactive whiteboards are now shipping, complete with new ergonomic pens and eraser, USB cable, wall- 
mounting brackets and the latest version of SMART Board software for Mac or PC for suggested list prices from 
US$999 to $1,999. www.smarttech.com 


3M Touch Systems enters into agreement with Immersion 
3M Touch Systems has announced an agreement with Immersion Corporation, a developer of tactile feedback 
technology, for 3M to manufacture and distribute MicroTouch touch screens that incorporate Immersion 
TouchSense technology for the casino gaming and bar-top amusement industries. This touch solution provides fast, 
tactile response for on-screen buttons commonly used in video gaming devices. Players perceive that on-screen 
buttons press and release as if they were physical buttons. In addition, TouchSense tactile sensations can be 
synchronized with sound and graphical images, creating a more immersive experience. www.3Mtouch.com. 


Elo introduces touch monitor for retail and hospitality markets 

Elo TouchSystems has introduced another entry-level touch monitor as part of its 
expanding 1000 series. The 1715L 17 inch LCD touch monitor joins the existing 1515L 
15 inch LCD to expand Elo’s family for system integrators and resellers in the retail 
and hospitality markets. The 1715L can function as a desktop or wall-mounted unit. 
The display is factory sealed against dirt, dust, and splashes. The monitor is available 
with Elo’s IntelliTouch surface-wave touch technology, plus a dual serial/USB touch 
interface. www.elotouch.com 





Hitachi and EverNote collaborate on handwriting recognition 

Hitachi Software has announced an agreement with EverNote Corporation to ship its ritePen handwriting 
recognition software with every new Hitachi Software StarBoard system. “ritePen software is the perfect 
complement to our StarBoard systems,” said Ralph Zak, director, interactive communications group of Hitachi 
Software Engineering America. “Excellent handwriting recognition is fundamental in the delivery of a classroom or 
corporate presentation." ritePen software automatically converts both printed and cursive handwriting into clean 
text. With Hitachi StarBoard pen-driven interactive systems, one uses the system pen right on the display surface to 
have one's freehand writing converted to clean text. ritePen also supports natural editing gestures, provides a list of 
alternative text recognition options, and a custom user dictionary to further improve recognition accuracy. 
www.hitachi-soft.com 
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GestureTek completes installation at the de Young Museum 

GestureTek Inc, a pioneer of gesture based control technology, was sought out by the San Francisco based de 
Young Museum to create a high-tech “Minority Report” like experience for their new facility which opened in 
October. GestureTek, working in conjunction with the architectural firm, Propp & Guerin, designed a space that 
creates an illusory atmosphere using four floor-to-ceiling clear glass panels that incorporate the new Illuminate 
Touch control technology and a projected interactive image. By simply using their hand, visitors either motion in 
front of or touch the glass to interact with the presentation which instantly reacts to the gestures. This experience is 
created by the system’s projector and tracking camera which, hidden from the public eye, allows for a seemingly 
technology free environment. The only visible element is the floating projected image created by a very thin 
projection film applied directly onto the glass panel. Projectors can be hidden in the ceiling or at a distance; the 
tracking camera, positioned directly on top of the projector, uses GestureTek’s tracking technology to detect the 
position of the user’s hand on the Illuminate Touch display. 


Horizon and General Touch team up on surface acoustic wave 
Horizon Technology, a distributor specializing in information storage and display products, has announced a 
strategic alliance with General Touch, a manufacturer of surface acoustic wave (SAW) touchscreens, to distribute 
its complete line of SAW and infrared touchscreens. The agreement will enable Horizon to provide its touch screen 
customers with lower cost solutions than currently available through Elo Touch Systems, the market leader in SAW 
touchscreens, it is claimed. Horizon's touch solution addresses applications including self-service terminals/kiosks, 
gaming machines, ATMs, POS, industrial automation, medical devices, and military. 


Synaptics integrates interface in latest Packard Bell MP3 
Synaptics Incorporated, a developer of interface solutions for mobile computing, communications, and 
entertainment devices, has announced the implementation of a LightTouch interface in the recently announced 
Packard Bell Vibe 500 hard drive MP3 player. LightTouch combines scrolling functionality with media controls for 
Menu, play/pause, fast forward and rewind. The media controls are illuminated with white LEDs. The entire 
Synaptics solution is integrated beneath the Vibe 500 case, resulting in a streamlined design. www.synaptics.com 


LaCie incorporates UPEK fingerprint protection 

UPEK, a supplier of biometric fingerprint security solutions, has announced that LaCie has expanded its product 
line of SAFE Mobile Hard Drives protected by UPEK’s TouchStrip Fingerprint Authentication Solution. The new 
SAFE Mobile Hard Drive incorporates two major pillars of information security, authentication and encryption, to 
safely protect large amounts of portable data. As with its predecessors, the SAFE Mobile Hard Drive with 
Encryption performs fingerprint authentication locally on the device instead of relying on the host PC, ensuring the 
highest level of security. Software running on the mobile hard drive facilitates transport and enables plug and play 
ease of use. www.lacie.com. 


Wacom introduces pen tablet for artists and designers 
Wacom Technology Corporation’s new Intuos3 6x11 pen tablet is specifically designed for photographers, 
designers and artists who are using multiple monitors or a widescreen display like the 23 inch Apple Cinema HD 
display. The Intuos3 6x11 features an active area with an aspect ratio that is a good match to the screen aspect ratio 
of either a widescreen display or two standard displays used together. This provides optimal pen control and 
efficient use of the entire tablet. “With as much as 50% of the creative community soon using either widescreens or 
dual monitors, we’re confident that the Intuos3 6x11 1s going to be very popular,” said Michael Marcum, Wacom’s 
director of product management. Intuos3 turns on the full power of Adobe Photoshop, Corel Painter and over 100 
other leading software applications with its intuitive controls. Programmable ExpressKeys and Touch Strips are 
within easy reach for modifier keys, keyboard shortcuts, scrolling, zooming, controlling brush size and more. The 
cordless, battery-free Grip Pen offers 1,024 levels of pressure sensitivity for superior creative input and, when used 
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alternately with the five-button Intuos3 mouse, reduces repetitive motion. The Intuos3 6x11 has a suggested retail 
price of $389.95. The Cintigq 21UX interactive pen display (priced at $2499) combines the advantages of an LCD 
monitor with the control and comfort of Wacom’s cordless, battery-free tablet technology. All Intuos3 pen tablets 
include Adobe Photoshop Elements 3 for digital photo editing, Corel Painter Essentials 2 for creating natural media 
art, Color Efex Pro 2 IE for selectively applying photographic enhancements, and Wacom Brushes 2 for more brush 
choices than in recent versions of Photoshop and Photoshop Elements. www.wacom.com 


Zytronic’s zero-drift touchscreen technology gives control to drivers 

Zytronic’s projected capacitive technology (PCT) touch sensors are mw available in 7 inch format suitable for 
automotive applications, allowing vehicle instruments to go touchscreen with the advantages of zero drift, optimum 
brightness and robust construction. Launching at the SID Vehicle Display 
Symposium held at the University of Michigan at Dearborn, US, in October, 
the new product will enhance the performance of satellite navigation systems 
and many other in-car user interfaces. PCT requires no external sensing array, 
unlike conventional capacitive or 5-wire resistive arrays. By embedding the 
sensing wires within the laminated screen, PCT enables very robust 
touchscreens capable of significantly exceeding the typical automotive 
watranty period. PCT also displays zero drift, which will maximize customer 
satisfaction as well as reducing returns and warranty overheads. The sensing 
array, which comprises micro-fine wires, also has negligible impact on light 
transmission through the screen. This gives designers the maximum control 
over screen brightness, and the inclusion of special filters allows them to 
optimize legibility in all lighting conditions from nighttime to direct bright 
sunlight, as well as minimizing overall power consumption. This is important 
as the increasing use of electronic systems on board the average car means that 
systems designers must manage power carefully, for a given alternator rating. 





Quantum unveils single ITO layer technology 
Quantum Research Group has unveiled a new technology, QField, which uses the company’s charge-transfer 
sensing techniques to enable the design of capacitive touch screens with a single conductive layer of indium tin 
oxide (ITO), rather than the two layers needed for resistive and other capacitive screens. NE Asia Online reports 
that QField technology removes the need for panel openings, seals and bezels because the ITO layer can be printed 
on the underside of the touch panel surface, which is typically glass or plastic. This feature is claimed to greatly 
simplify construction and lower manufacturing costs. The touch panel can be up to 3 mm thick and the reduction to 
only one ITO layer makes the screen more transparent, with up to 90% light transmission. The same technology can 
be applied to flexible or curved surfaces. Quantum will be introducing a family of integrated circuits that can be 
used to implement QField technology and will advise customers with respect to appropriate physical construction 
of their touch screens and choice of ITO vendors. Features of the devices will include X-Y coordinate output, 256 x 
256 pixel resolution, gloved hand operation, 20 ms response time and micro-amp current consumption in low- 
power mode. The new invention makes obsolete most resistive-type touch screens of up to 4 inches diagonal, 
according to the company, and is expected to make significant inroads into touch screens of up to 10 inches 
diagonal. QField touch screens are based on Quantum's charge-transfer sensing technology, which is claimed to be 
much more accurate and reliable than traditional capacitive sensing. It involves charging a sense electrode, in this 
case the ITO layer, then transferring the charge to a detector comprising a fixed capacitor. The charge transfer 
acquisition process 1s carried out in burst mode using microprocessor-controlled switching of MOSFET transistors. 
The presence of the external capacitance of a finger affects the flow of charge to permit sensing. A spread-spectrum 
sensing mode is used to reduce RF emissions and susceptibility. Potential applications for the technology include 
consumer electronic products such as mobile phones, personal computers, PDAs and MP3 players. 
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Tablet PC News 


Why Tablet PCs have not taken off... 


Five years ago at Comdex, Microsoft’ s Bill Gates delivered a keynote address focusing on tablet computing. Hailed 
as the next major evolution in PC design and functionality, Gates explained, “The tablet PC extends the power of 
personal computing into exciting new areas. Combining the simplicity of paper with the power of the PC will 
enable people to be far more productive. It makes a PC an even more valuable tool for enterprise computer users 
who spend time in meetings or away from their desks.” A couple of years later, however, Microsoft released 
Windows XP Tablet PC Edition, signaling its belief that the market for tablet computing would expand 
significantly, with Gates suggesting that Tablet PCs would outnumber traditional clamshell-style notebook PCs by 
within 5 years. 


By Mark Fihn 


Well, despite Mr. Gates’ predictions, the Tablet PC didn’t take off. Actually, I must admit that I personally agreed 
fully with Bill Gates, and thought the Tablet PC would be extremely successful in the market. The rationale for 
pen-enabled computing makes sense. So why has the launch of the Tablet PC been so slow? Let me offer three 
explanations: 


1. The primary reason the Tablet PC didn’t launch into the mainstream over the past 5 years is because only 
half of the major players in the notebook PC market came out with products. HP, Toshiba, Acer, Fujitsu, 
NEC, and Sharp came out with Tablet PCs, but Dell, Sony, Apple, and IBM did not. So we had a situation 
where some of the major marketers in the world were busy telling their customers not to buy a Tablet PC — 
that the technology was just not ready, and that the traditional notebook form factor was superior. When 
otherwise innovative companies like Sony, Apple, and IBM, and market leader Dell repeatedly downplayed 
the Tablet PC, cautious buyers balked on their way to the sales counter. I firmly believe that if one or two 
of these major players had joined the Tablet PC bandwagon, that sales would have been much better. Now 
that IBM (Lenovo) has introduced a Tablet PC, perhaps sales will begin to pick up... 

2. Tablet PC manufacturers, for the most part, focused on a rapidly diminishing segment of the notebook PC 
market. The vast majority of Tablet PCs available today are sized with relatively small displays, 12.1-inch 
and smaller. Only a few Tablet PCs come with 14.1-inch displays. Yet the notebook PC market as a whole 
has shifted to 15.0-inch and larger displays. The sub 14.1-inch market for notebook PCs represents little 
more than 10% of the total notebook PC market. In other words, Tablet PCs have never really attempted to 
compete against the mainstream notebook PC market, simply due to what consumers are demanding in 
terms of display size. 

3. While sales of Tablet PCs have been relatively small, it should be remembered that as recently as only three 
years ago, only about a dozen models were available — contrasted to several hundreds of notebook PC 
models from more than 200 notebook PC brands. Today, although the pace of development of unique 
Tablet PC ideas has slowed, many notebook PC brands carry a Tablet PC in their line-up, (still excepting 
Dell, Sony, and Apple). 


I personally remain convinced that Tablet PCs will eventually displace a substantial portion of the notebook PC 
market. I suspect that Apple will soon wake-up to the fact that the ultimate video iPod will have a much bigger 
screen; when Sony’s AirBoard resurfaces, and when Dell finally realizes that one of the reasons their notebook 
sales are lagging the rest of the market, that then Tablet PCs will indeed take off. 


As a routine feature of the Touch Panel, we intend to cover news about the latest developments in the Tablet PC 
market, particularly as related to the display, the touchscreens, and the handwriting software that drives the touch 
technology. 
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IBM Lenovo ThinkPad X41: It didn’t happen under the IBM reign, but one of the 
first products introduced after the Lenovo acquisition was the ThinkPad X41, a 
convertible Tablet PC. Featuring a 12.1-inch screen (1024x768 pixels), a biometric 
fingerprint reader for security, Intel s Pentium M 758 processor at 1.5GHz, 512MB 
of system memory, Intel s GMA 900 graphics chipset, and a 40GB HDD, (which is 
shock-protected with gyro sensors to protect drive heads. The system does not have 
an internal optical drive. The unit was initially priced at US$1900, and is 
reportedly selling well in the China market. 





While IBM was slow to introduce a Tablet PC, the ThinkPad X41 comes from a IBM L = 

l , l enovo ThinkPad 
long legacy of IBM’s technological development related to tablet-style devices X41 Tablet PC (2005) 
dating back to as early as 1993: 





ThinkPad 710T (1993) IBM 9103-A25 (1998) IBM ThinkPad TransNote (2001) 


One of the original Microsoft Tablet PC partners was FinePoint Innovations, a developer of digitizers appropriate 
for Tablet PCs. In September, InPlay Technologies announced the completion of their acquisition of FinePoint, a 
privately held company. FinePoint’s digital computing pen technology consists of a digitizer and digital writing 
pen. The pen is an active RF digital pen versus the typical analog pen used with most tablet PC systems. 


On November 10, Mercury Computer Systems of Chelmsford, Massachusetts, announced its collaboration with 
ASPX LLC on a proof-of- concept ground station application of the VistaNav-SPX remote co-pilot system. The 
VistaNav-SPX remote co-pilot system is designed to improve the safety of single-pilot, high-performance aircraft 
operations with real-time, 3D full- terrain views. The system receives data and voice information through a dual- 
channel satellite communications transceiver in the airplane. The information is routed to the Mercury VistaNav- 
SPX ground station featuring a real-time 3D synthetic vision display. This station can be located anywhere in the 
world, and allows a trained ground station pilot to iis bats Wises ase Peace 
provide all the cockpit resource management and a ; me CO | 
monitoring functions that would normally be performed F fied ey eee 
from the co-pilot seat, to up to four airborne pilots. The 
2.2-lb tablet-style device (which Mercury calls a 
Mobile Computing Platform — MCP) comes with =i 
Microsoft’s Windows XP Tablet PC Edition, Intel’s kf 
Pentium M at 1.2GHz, an 8.4” LCD at 800x600 pixels 
with 225% improved sunlight contrast ratio, 128MB of 
video memory, 512MB of system memory, and a 30GB 
HDD. 





T ASA 


Mercury’s VistaNav MCP 
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Gateway recently introduced their CX2600 Tablet PC, a convertible 
device priced for as little as $1249. Featuring a 14.0-inch widescreen 


November 2005 


LCD (at 1280x768 pixels), the 6-Ib tablet comes with a 5-in-1 flash card M =. 


reader, wireless networking and slots for batteries that last for up to nine 
hours. It comes with Microsoft OneNote software, 512MB DDR2 
memory, an 80GB hard drive, Intel PRO/Wireless LAN 802.11g, and 
reads and writes DVDs and CDs. Although Gateway was one of the 
first to introduce a Tablet PC in a widescreen format, their choice of a 
14.0-inch panel in the quirky 15:9 format is odd. Virtually all 
widescreen notebooks utilize the standardized 16:10 aspect ratio. The 
nonstandard format has several known problems associated with 
optimal software utilization. 





Gateway CX?600 


Lexington, Massachusetts-based, Pepper Computer recently began shipping its wireless Pepper Pad. According 
to the company, the Pepper Pad is the first portable wireless device that gives consumers instant Internet and digital 
media while also controlling other in-home devices. The Pepper Pad includes: Mozilla-based Web browsing, AOL 
instant messaging, and e-mail; software to collect, organize and share videos, music and photos; and TV and stereo 

remote control. The Pepper Pad is initially available exclusively through 





The PepperPad 


and game playing. 


Taiwan-based Dialogue Technology recently introduced their FlyBook 3G. The 
small device features an 8.9” widescreen LTPS LCD at 1024x600 pixels with a 
resistive touchscreen. The FlyBook is configured with Microsoft s Windows XP 
Home or Professional Edition, (not the Tablet PC Edition), built-in 802.11B wireless 
LAN and antenna, Transmeta’s Crusoe TM-5800 1GHz processor, ATi’s Radeon 


Mobility video controller, 512MB of system memory, and a 40GB HDD. 


Amazon.com at $799.99. The 2-3lb device is configured with a 20GB hard disk, 
built in speakers, thumb keypad, an 8.4-inch LCD (at 800x600 pixels) with a 
resistive touchscreen, and comes with three forms of wireless communication — 
Wi-Fi, Bluetooth and infrared (IR) — enabling the Pad to access and control a 
wide range of devices around the home, from Wi-Fi access points, to keyboards 
and mice, to TVs, set-top boxes, music systems, home theaters and media servers. 
The system is based on a 624-MHz Intel PXA270 application processor, Intel 
2700G media processor and 256 MB of SDRAM. It also features built-in stereo 
speakers and microphone, jacks for headphones, 
external microphone and external video display, 
plus a direction-pad and scroll wheel for navigation 





Dialogue FlyBook 3G 


Bangalore, India-based Connoisseur Electronics has introduced the Connoi T 





clamshell notebook PCs. 


Connoi T2300 


15 


2300 - a Tablet PC fitted with Intel’s Pentium M Processor 735 at 1.70 GHz, 
Microsoft’s Windows XP Tablet PC Edition, 512MB DDR memory, upgradeable to 
2GB, 80 GB HDD, a DVD/CD-RW combo drive, built-in LAN, and a 12.1-inch 
LCD (at 1024x768 pixels) supporting EMR pen-based input (at 1024x768 
Resolution). This is one of the first Tablet PCs to be introduced by a local Indian 
brand and it has been introduced at price points comparable to those of traditional 
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Mobile systems software vendor Handango has entered the market for downloadable Tablet PC software with the 
launch of a Tablet PC catalog. Customers can download applications at Handango's Web site and on the Microsoft 
Windows XP Tablet PC Software store. Additionally, Handango has extended its marketplace platform, Handango 
AMPP, to support Tablet PC applications, enabling Tablet PC manufacturers to create new streams of revenue 


through their own branded software storefronts. 


The Fujitsu LifeBook P1510D is a 2.2-Ib convertible Tablet PC configured 
with a 1.2-GHz Pentium M processor with 512 MB of DDR SDRAM 
(upgradeable to 1GB), an 8.9-inch LCD (at 1024x600 pixels), a 30GB HDD 
(upgradeable to 60GB), a built-in microphone, fingerprint sensor, and a built- 
in universal lock slot for data security. The system is priced at $1,649, but 
with extra components is likely to cost close to $2,000. An extended battery 





oT hen! i 
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life feature claims to power the system for 7 hours continuously. Fujitsu LifeBook P1510D 





Saharai215 Pinkie 


TabletKiosk announced the release of their newest slate-style Tablet PC, the 
Sahara 1215 Pinkie, benefiting the fight against Breast Cancer. TabletKiosk has 
teamed up with the American Breast Cancer Foundation in the marketing of its new 
Pink Tablet PC, with a portion of the proceeds for each unit sold going to ABCF for 
the fight against breast cancer. The Sahara 1215 Pinkie utilizes the latest Intel low 
voltage processor running at 1.5 GHz with 2MB L2 cache, 512MB of system 
memory (upgradeable to 1GB, a 60GB HDD (upgradeable to 120GB), worldwide 
wireless capabilities with an Intel PRO/Wireless 2915ABG (802.1 1a/b/g) wireless 
module. The system includes a Hydis 12.1-inch Wide Viewing Angle Display, (at 
1024x768 pixels); offering claimed viewing angles of up to 180 degrees. Every 
Sahara 1215 Pinkie comes with a Black Ballistic Nylon Portfolio Carrying case with 
Pink Piping and the Pink Breast Cancer ribbon logo. 


In early November, Toshiba announced a refresh of their popular Portégé 
M200 convertible Tablet PC. The upgraded M200 Tablet PC has a new 12.1- 
inch (1024x768) wide-view screen to improve users’ ability to view the screen 
at any angle. The Portégé M200 lacks an internal optical drive, but an 
external USB DVD/CD-RW combo drive is available. The device comes with 
an Intel Pentium M processor at 1.6GHz, 256MB of system memory, the 
NVidia GeForce FX Go5200, and a 60GB HDD. 


On November 22, Acer introduced their TravelMate C200 series of Tablet 
PCs, which features a patented sliding-track mechanism to enable a non- 





Toshiba Portégé M200 


swivel convertible notebook functionality. The 12.l-inch device (at 1024x768 pixels) allows for a one-motion 
conversion from Notebook mode to Tablet mode. The system can be converted from Tablet to PC mode by pushing 
the LCD module from its closed position to the upright location of a typical notebook PC. The TravelMate C200 





Acer TravelMate C200 





series includes the new Intel "Sonoma" platform that combines Intel’s Pentium M 
processor and the Mobile Intel 915PM/GM Express chipset, the 256/512MB 
scalable to 2GB of system memory, up to 100GB of HDD storage capacity, 
biometric fingerprint ID control, a slot loading DVD/CD-RW burner and a 4in-1 
card reader that supports SD, MMC, Memory Stick, and Memory Stick PRO 
standards. The TravelMate C200 series also integrates a software utility designed 
for Tablet PC users and is especially useful when in tablet mode when hot keys 
cannot be reached easily, the Acer Soft Button provides rapid software launches 
and access to connectivity options. Pricing starts at $1399. 
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Interview with John Stetson of Gunze USA 


By Mark Fihn 


Prior to joining Gunze USA, where John Stetson is sales manager, he served as president and 
COO of Digital Assist Inc, a Texas start-up software company specializing in computer 
applications for handheld platforms. With more than 20 years of marketing and sales 
management experience in the high-tech arena, John has held executive positions in various 
companies in the computer industry including OfficeDomain, ProTrader Securities, Digital 
Equipment Corp, USSI, CMAC, and JRL Systems. 


Can you tell us about Gunze’s corporate structure and describe how Gunze USA ended 
up in Austin, Texas. In 1984 Carroll Touch, pioneer in the touch industry and manufacturer 
of infrared scanning touch systems, moved operations to the Austin area from Champaign, Illinois. Sometime after 
that, Carroll Touch bought a small analog resistive touch panel manufacturer which then spun off other touch 
concerns, one of which was later acquired by Gunze Ltd of Japan, our parent company, and became Gunze USA. 





You do more than sales support in the US; please describe the manufacturing that goes on at your Texas 
facility. We have a 20,000 square foot manufacturing facility here with a Class 10,000 clean room and plans to 
expand in the near future. We support manufacturing for the low-volume North American business in Austin. 
Higher volume manufacturing takes place in Asia. 


You produce polycarbonate and glass substrate resistive touchscreens. Describe the differences between the 
two substrates, both in terms of performance and applications. The polycarbonate substance is lighter than 
glass and more flexible, so it is more impact resistant. But the drawback of polycarbonate is that it can sag over 
larger sizes so we only use it for displays up to 6-inches in diagonal. Moreover, the coefficient of expansion and 
contraction of ITO, the conductive coating used with resistive touch panels, is not as closely matched to 
polycarbonate as it is with glass. So we can't sputter the ITO directly onto the polycarbonate substrate like we can 
with glass. Therefore, the construction of our polycarbonate touch panels is film/film/polycarbonate as opposed to 
film/glass construction when using glass as a substrate. The polycarbonate touch panels require that extra layer. It 
is also slightly less transparent than glass. 


Gunze recently announced a new “highly transmissive circular polarizer’ touch panel. Tell us about this 
technology and where it will be used. Polarized touch panels are used in direct sunlight applications. The net 
result of their use is like putting sunglasses on the touch panel. Gunze has developed a new thinner version of the 
polarizer layer which results in as much as a 13% increase in light transmissivity from the LCD display. The 
common applications we see employing this technology are mobile computing, laptops and tablets, and off-road 
construction and agricultural equipment cabs, military aircraft, and handheld GPS devices. 


Gunze claims to be “the leader in resistive touch panel manufacturing”. Is this leadership based on 
technology or production output? Both. We were the first to bring the circular polarizer touch panel to the 
market and we lead in terms of our anti-reflective treatments. We also produce about 25% of the analog resistive 
touch panel volume, the largest share of the pure touch market. But a lot of that business is OEM business. So the 
consumer won't see Gunze's name on the finished product. 


How big do you think the resistive touchscreen market is in terms of revenues? Our estimates are over $3b. 


What are the biggest applications for resistive touchscreens? The biggest applications for Gunze include PDAs 
and handheld devices for GPS products, mobile computing, and industrial control. 
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Do you have plans to introduce capacitive touchscreens or other touchscreen technologies? We are expecting 
to introduce a capacitive touch screen in 2006. 


Do you foresee any alternatives to ITO thin film sputtering? I've heard rumors of some nano-tube stuff. 


Give us your thoughts about the challenges associated with touchscreen technologies in relation to flexible 
displays. I know flexible display technology is bleeding edge right now. But I'm not currently aware of any 
resistive technology that doesn't require a rigid substrate. 


Are there any limitations in terms of resolution for your touchscreens? Depending on what type of controller 
you are using (10 or 12 bit) the end result is 1024 x 1024 or 4000 x 4000; plenty fine enough to accommodate 
finger input or signature capture with a stylus. I don't know what the theoretical limitations are, but the present 
practical limitations are adequate for the requirements we see. 


How about size limitations? 19 inch diagonal is as big as we make. Going beyond that size presents linearity 
problems with analog resistive touch panels. 


Does Gunze also manufacture touchscreen controllers? We do; in both board and chip configurations and 
serial, USB, and PS2 interfaces. 


Any exciting new plans in the works? We've made some production enhancements lately that allow us to 
streamline our process lines to achieve greater sputtering efficiency. We're introducing some new EMI shielding 
mesh and top films that are less susceptible to UV discoloration. 


Gunze’s Circular Polarizer Structure 
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SID: Americas Display Engineering 
and Applications Conference 
(ADEAC 2005), October 24-27, Portland, US 


Phillip Hill reports on the papers presented relating to touch screens. The first 
gives a general overview of touch technologies available and suggests 
a machine vision alternative. 


23.3: From Small Size to Wall Size: A Versatile Touch Technology for Interactive Displays 
Gerald Morrison, Tanya Oleskevich, and Daniel McReynolds 
SMART Technologies Inc, Calgary, Canada 


Today’s touch screen technologies are not suitable for display sizes that range from desktop displays to wall 
displays, according to Canadian company Smart Technologies. Also, the differing requirements for a touch enabled 
desktop display are quite different from those of a touch enabled wall display. But Smart Technologies has come up 
with a machine vision system that does scale from small display formats to very large displays formats including 
wall-sized displays. The technology uses smart cameras to acquire and analyze images of the scene directly in front 
of a computer display, whether LCD, plasma, or projected. The analysis determines where a user has touched the 
display and then treats that information as a mouse click thereby allowing the computer to be controlled. 


When using a desktop display for touch input as well as pen input, the system must recognize finger for touch but 
must also have some ability to handle palm reject when being used with a pen. As displays get larger, multi-user 
collaboration is important and the ability to recognize 
two or more simultaneous inputs is desirable. These 
requirements are difficult to meet using existing 
technologies. 


When the display size increases, the touch area 
increases and the usability of the system changes from 
one where only a single user has enough room to work 
to a system where many users can work on the same 
display. Common touch technologies like analog 
resistive, surface acoustic wave, capacitive and infrared 
beam can only support a single user. These same 
technologies also report only the touch location and 
cannot give information about the size of the object 
touching the display or recognize what type of object it 
is, for example, a finger, pen, or eraser. 





Figure 1: A 17 foot wide wall display system with 
multi-user touch 


Another limitation of these technologies is the ability to 
scale between small and large displays, which becomes difficult or perhaps so impractical that implementation is 
nearly impossible. For example, creating an analog resistive touch panel to fit a 100 inch projected display cannot 
be done as present analog resistive materials, indium tin oxide for example, are not available in such large sizes. 
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Furthermore, a display projected on a wall, for example, has no real technology infrastructure other than the wall 
itself that cannot be made touch sensitive without the addition of some type of mechanism. Machine vision systems 
are ideally suited to enabling a wide range of touch systems, says Smart Technologies. Machine vision systems are 
attractive because they can be made inexpensively as more functionality is integrated into a single chip. 


A requirement for high-resolution touch surfaces is the ability to detect when the pointer is in contact with the 
touch surface and it is necessary for writing, drawing, mouse-click operations, etc. A secondary requirement is the 
ability to detect when the pointer is “hovering” above the touch surface. Although not required for writing or 
drawing, today’s computer operating systems make increasing use of hover information to manipulate the display 
or provide pop-up information boxes. No passive touch surface in use today can detect both when a pointer is 
hovering over the touch surface and when a pointer is in contact with the surface. Scalability of touch technology is 
also important since the demand for larger electronic digitizers is increasing. Touch screens in use today are all 
limited in the maximum size where they are still functional. This is due to mechanical constraints or technological 
limits. 


Common touch technologies include analog resistive, surface acoustic wave, capacitive and infrared beam. 


Analog resistive: Analog resistive systems produce high resolution touch surfaces using two flexible sheets coated 
with a resistive material, arranged as a sandwich. Mechanical pressure is required to bring the sheets into contact to 
register a contact event. Hence, a minimum pressure is required for a contact event to occur. Thus, there is no 
possibility of sensing when a pointer is hovering over the touch surface. 

Acoustic: Surface acoustic wave (SAW) systems employ transducers on the borders of a glass surface that vibrate 
the glass, producing acoustic waves that ripple over the glass. Reflectors are strategically placed along the glass 
border to assist in determining the position of the reflected wave (the touch location). The contact event and 
position can only be discovered when the actual contact is made and so hover capabilities are not available. 
Capacitive: Capacitive touch screens provide only low resolution measurements because the touch point can only 
be determined in a large area. These systems are not typically used for writing and drawing, but are suitable for 
touching computer-generated buttons. Capacitive touch technology is not readily scaleable to large sizes. Hover is 
not practical in these systems and so a touch is registered only when there is a reliable contact on the touch surface. 
Infrared LED: This system consists of numerous infrared LEDs (transmitters) spaced on two adjacent borders and 
numerous photoreceptors (receivers) on the other two borders. When an object comes between the transmitters and 
receivers, the infrared path is broken and the coordinate position is discovered. This system can detect either hover 
or contact but not both. These systems do not scale well as the infrared beams become diffuse with distance; 
therefore, less power reaches the photoreceptors, which results in decreased detection reliability. 


The novel technology, called DViT and presented 
by Smart Technologies at ADEAC, uses smart 
CMOS cameras (see Figure 2) in the corners of a 
display to look along the surface of the display and 
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determine the location of an object in front of, or in 
contact with, the display. Typically, the object of 
interest is the user’s finger. The images collected 
by the cameras are processed in such a way as to 
recognize various attributes of the object, such as 
location relative to the display in three dimensional 
space. This information is then used in feedback to 
the computer generating the display so that touch 
control of the application can be enabled. The 
diagram of the electronic system architecture is 
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Figure 2: DViT smart camera 
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shownin Figure 3. There can be many cameras in a system but for single rectangular systems, the number of 
cameras is typically limited to four (one in each corner). Other systems can function with as few as two cameras or 
as many as are required to observe the display (a wall size system needs multiple pairs of cameras to observe the 
entire surface — see Figure 1). 


iac Control Bus The company has developed a new camera based 

= P AET desktop display called the DT770 shown in Figure 

EPROM felt Be dita} Fie goats ee 4. The DT770 is a 17 inch interactive display that 
z z a incorporates machine vision technology in a 
boardroom compatible desktop format that provides 
both finger and pen capability in a seamless 





[a Muster Contra key interchangeable manner. Previous adaptations of 
OS —— the DViT technology have ranged for 40 inch to 17 
‘alten Comers S EE MASTER foot formats. For this desktop format several novel 


design features have been incorporated to reduce 
cost, increase system robustness and 
manufacturability. The DT770 consists of two 
cameras and an opposing mirror. Image analysis is 
performed on the superposition of direct and 
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Ta Computer . — 
reflected images, thereby providing a palm-reject 
Figure 3: Architecture of the camera-based touch feature. An automatic mode switch is located in the 
interface pen docking recess to provide an intuitive and 


seamless switch from pen mode to finger mode. 


To apply DViT technology to smaller, tabletop formats several new features are required. In this user environment, 
in which the interface is very similar to handwriting in a notebook, it became obvious that a successful palm reject 
feature would be critical. In addition, for presentations in a lecture hall, finger friendly navigation would greatly 
enhance the usability in a darkened room. To provide an intuitive and friendly interface between these two modes 
of operation, the transition would have to appear seamless. To this end, the 17 inch version incorporates both 
passive and active touch modes, which automatically switch as the user picks up the pen. To reduce footprint and 
overall system cost, the image processing consists of only 
two imaging cameras and an opposing mirror as illustrated in 
Figure 5 next page. 


The reflected images from the mirror provide sufficient 
information for location determination in the event of 
significant shadowing from the user’s hand during normal 
writing, regardless of handedness. In active pen mode, the 
object location is determined by locating the illuminated pen 
tip against a dark background. The user can switch from 
writing to pointer mode via manual buttons located at the top 
of the tablet. As the user’s hand obscures the pen tip from 
one camera, the two images created by the direct and 
reflected images provide sufficient information for the 
cameras to locate the pen tip along the table. 





Figure 4: A 17 inch touch display with finger 
and pen input 


In the passive, or finger mode, the cameras capture a dark image against a bright illuminated bezel (infrared). For 
the 17 inch format, design efforts were directed towards improving the uniformity of the bezel illumination while 
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decreasing the power load and overall footprint. This was achieved with a three-fold optical light pipe, an 
optimized planar diffuser film and a novel collimating optic. The light pipe is an injection-molded polycarbonate 
for good optical clarity, repeatability and low cost. The new bezel design resulted in a three-fold decrease in the IR 
LED density, while providing improved brightness uniformity relative to the original larger format screens. 


A similar, three-fold design is used for each of the cameras, which are 
located at the corners, and attached below the plane of the tablet, much like 
a periscope. The camera consists of a 100 deg FOV focusing lens with a 
CMOS sensor (1280 x 1024). The sensor ROI is electronically controlled to 
provide only 40 rows to enable fast image processing (100 fps). 


With DViT technology, the tablet surface can be a simple construct of glass 
and a single filmoverlay for antiglare and anti-smudge properties. This 
allows for high transmission, and overall brightness approaches the native 
brightness of the underlying LCD. Tests for abrasion with the pen tip show 
no degradation to either the pen tip or the tablet after kilometers of repeated 
surface writing. The film also provides an improved tactile experience, very 
similar to pen on paper. 





























Wirror 


Figure 5: Trace test showing 
direct and reflected images 


For accurate camera tracking during pen writing, the radial intensity emitted by the active pen tip must be uniform 
over the range of human writing angles. After several iterations, a simple robust tip was developed that uses the 
intrinsic random scattering properties of the tip material and a tailored wall thickness to provide an inexpensive, 
effective solution. The combination of the pen tip design and the extremely fast frame rates create a very smooth, 
low lag, natural writing experience. 


A seamless transition between active pen mode and passive finger mode is achieved through a magnetic switch 
located in the pen tray. A blue LED illuminates the distal end of the pen to provide feedback to the user for on/off 
status. This two-camera opposing- mirror configuration is easily scalable to other size formats and developments are 
underway, the company says. 


Machine vision can be used to create a touch interface of arbitrary size due to the fact that the resolution of the 
system 1s optically based. This means that for any projected display, there is a proportional correspondence between 
the display pixels and the camera pixels. Therefore, if the resolution of the 
camera system allows a touch resolution of say, one display pixel, then that touch 
resolution will not change no matter how small or how large the display pixel is. 
In other words, whether a display occupies a 17 inch LCD or is displayed on a 17 
foot wall, the capabilities of the machine vision system remain the same as long 
as the camera resolution is sufficient for pointer identification. This optical 
scaling ability is an important feature when making large format displays touch 
sensitive, but it also allows for the creation of small display touch systems, as 
with the DT770 system. 





Figure 6 and Figure I show two types of large-format touch displays. In Figure 6 A . 
is pictured an 84 inch camera-based touch sensitive display that can be used for p; gure 6: An 84 inch touch 
presentation, training or any type of computer application control. Figure l 
shows two users simultaneously using a 17 foot wide display. 





display 
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23.2: Selecting Resistive Touch Panels to Match the LCD and User Application 
Bruce C. DeVisser 
Product Marketing, Fujitsu Components America, Sunnyvale, US 


Bruce DeVisser gave a presentation of relevant criteria to be used by engineers, designers, product developers and 
end users in selecting resistive touch panels for use with flat panel displays for creation of touch-enabled human 
machine interfaces (HMIs). The trend to incorporate a touch-enabled HMI has expanded to encompass products 
that previously did not use an LCD, and those that have LCDs but lack a touchenabled interface. Examples include 
medical monitors, electronic control systems, and various instrumentation applications. 


Resistive touch panels (RTPs) are the most widely used type of touch interface for display applications due to their 
simplicity, relatively low cost, high level of interface support by microcontroller, microprocessor and single board 
computer (SBC) makers. But, says DeVisser, the people charged with selecting and applying a touch interface are 
often lacking the information they need to make an informed selection decision. This is often due to the newness of 
touch technology to the application area, inexperience with modern HMIs, or cross-functional assignment of 
engineers and other design people to unfamiliar areas. 


Probably the most commonly known touch enabled HMI application is the personal digital assistant (PDA), but the 
current range of applications extends to ruggedized portable equipment, medical electronics, automotive 
electronics, public information terminals, point of sale (POS) devices, tablet PCs and many more HMI-based 
devices. The numerous design requirements that vary with the application area, but can be separated into four 
general categories: optical performance, electrical performance, application dynamics, and operating environment. 


Optical Performance: These considerations are the most complex because 
performance can be affected by nearly every other design choice, but selection 
can be logically approached beginning with the type and size of display and 
progressing through related criteria. RTP basic top-to-bottom layer construction 
consists of a hard coat (applied to film), flexible plastic film (PET), ITO resistive 
coating (applied to film), spacer dots, ITO resistive coating (applied to glass), and 
the glass panel (Figure 1). 





LCD 


Of these items, typical available choices include: 
e glass type: normal (soda) glass or chemically strengthened (CS) glass 
e glass thickness: typically 1.1 mm for most applications, although this range Figure 1: Resistive touch 


extends from 0.55 mm thin to 1.8 mm thick and greater panel basic construction; 
e ITO coating: variety of color effects an LCD is included for 
e hard coat: clear or anti-glare (AG) surface scale reference 

e transmissivity or transparency: typically 78 to 82% with more than 92% 

available 


Glass choices are relatively simple: thinner is better for weight and optical requirements as long as strength goals 
are met. Glass strength, however, is an area that is often not defined because it is difficult to accurately characterize 
the user environment, and it ends up being evaluated naturally through user trials. Typically, LCD sizes less than 4 
inches use 0.7 mm glass with larger sizes using 1.1 mm or thicker glass. In the most demanding situations CS glass 
can be used to increase glass tensile strength by a factor of 3 to 5 times. 


ITO choices are not often a difficult issue, as vendor samples can easily be used to determine if there is any 
undesired coloration effect from the chosen product range. In the case where some color change is desired, it is 
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necessary to provide a working LCD sample to the RTP vendor to aid in selecting the most appropriate ITO coating 
to meet color goals for the specific LCD + RTP assembly. 


Hard coat is the protective finish applied to the exterior of the plastic film layer, which is contacted by the user, and 
there are two basic types: clear and anti-glare. Clear hard coat has a minimum effect on the LCD image, although 
there is always some measurable effect from any additional optical layer. Clear has the disadvantage of first surface 
glare and it is scratched more easily than AG. Clear is the most prevalent choice for reflective applications because 
it doesn’t scatter or diffuse the light. It is also becoming popular for transflective and some transmissive LCD uses. 
Anti-glare hard coat is used to reduce first-surface reflections, commonly termed “glare”. It is sometimes referred 
to as “white shirt” œ “mirror-effect”. Optically, AG hard coat scatters a portion of the light reflecting off the 
surface. Often the image on the LCD is also diffused, which can be perceived as reduced contrast. This effect 
increases significantly as the distance between the LCD surface and the RTP increases. Anti-glare also results in a 
reduced viewing angle, although this is apparent mainly with extreme viewing angles and is not a concern in most 
cases. Anti-glare also provides the best resistance to scratching of the hard coat, which is an important 
consideration for pen-centric applications, where a stylus is primarily used for touch interactions. Finally, AG can 
be effectively treated to embody anti-smudge properties. This is important where oily fingerprints could build up 
and interfere with LCD visibility, such as with many portable devices. 


Transmissivity (or transparency) is the measure of how much of the LCD’s light, both reflected and transmitted, 
reaches the user through the touch panel. For example, 80% transmissivity generally means an LCD with a 100 
cd/m’ output will measure 80 cd/m? at the user’s viewing point. A transmissivity range of 78 to 82% is predominant 
among products offered in the market today, and typically 80% is used as a reference value for resistive touch 
panels as this level of performance is well-suited to a broad range of applications. For more demanding 
applications, the range of 84% to 92% is available, but each percentage increase brings added cost, which can more 
than double the base touch panel cost. The main methods used to improve transmissivity are ITO coating 
formulation and anti-reflective (AR) coatings, also known as index matching (IM) coatings. AR coatings are 
implemented by coatings applied to the glass and film at the time of manufacture, or subsequently through 
application of films containing the AR coating. Most higher transmissivity products are custom or special order 
items, so determining and selecting a solution is usually done with reference samples, although certain situations 
demand a properly fitted touch panel for effective display assembly evaluation. 


Electrical Performance: Electrical performance is usually not a major concern, with the exception of EMI- 
sensitive and/or RF-intensive products, which may require counter measures that adversely affect optical 
performance, weight, thickness and cost, and is a specialized topic. Resolution and touch response are circuit- 
dependent insofar as A/D range and processing speed are concerned, however, most RTP controllers offer adequate 
resolution and speed, with up to 4096 x 4096 point resolution and sub 50 ms response available. Software operation 
is more typically the cause of resolution and touch response anomalies. 


Application Dynamics: Application dynamics describes the way the product is designed to be used, and must 
consider the user profile as well as a mode-of-use model. The user may operate a product in a manner that the 
designer did not intend - careful consideration of potential use outside specifications can avoid problems and 
possible product failure. When a product is a completely new type, it may be difficult to quantify accurately how 
the product will be used, so previous experience with similar applications becomes a valuable reference. For 
example, in designing a new test instrument one could examine how the target user audience currently uses other 
instruments, and develop a use model based on that data. Upgrades and product extensions are the easiest to 
specify, as the use model is already known, and often even new application areas can be reasonably modeled. In 
either case, accurate specifications at the beginning of a project will prevent major failures when performance 
testing begins; further, the specific test modalities and methodologies need to be agreed in advance, as the design 
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engineer’s concept of qualification testing may not coincide with the manufacturer’s standard battery of tests. 
Operating Environment: The operating environment of the end user is often a critical factor in choosing or not 
choosing a resistive touch panel solution, and is directly linked to application dynamics. Temperature, humidity, 
NEMA, IP or other rating requirements must be carefully weighed against specified capabilities. Resistive touch 
panels are the lowest cost of current touch technologies, so it is not hard to imagine that there are accompanying 
limitations, especially when one considers hostile operating environments. Elevated temperature is one of the worst 
enemies of electronic device life, and when high humidity is added it combines to make life very short for typical 
resistive touch panels. Fortunately the majority of applications are within standard commercial temperature and 
humidity ranges, allowing the unrestricted application of resistive touch panels across a very wide range of product 
types. In those situations where higher environmental standards must be met there are several design options 
available to increase specified performance ranges. Currently RTPs are available to meet automotive interior 
electronics requirements, which include operating up to 85°C and 85% humidity. 


23.1: Invited Paper: Integrating Touch Screens and Optical Films: When, Where, and How? 
Shane DeWitt 
Marketing Manager, 3M Touch Systems, Canada 


In an invited paper, Shane DeWitt explained how 3M has converged touch screen and optical film technologies to 
respond to customer concerns about touch displays that were turning black due to internal heating caused in part by 
prolonged exposure to sunlight. The presentation examined how a non-metallic multi-layer film that was originally 
used with a non-touch application was integrated with a capacitive touch screen with the objective of solving this 
issue. The advantages and challenges that accompanied integration of infrared-reflecting film with a capacitive 
touch screen technology were covered. The case of another recent film/touch integration was also briefly discussed 
and compared to the first case. 


DeWitt pointed out that, as touch screen technology matures and is adopted as the interface for more and more 
products and services, consumers increasingly expect touch products to be usable in various settings and 
conditions. Such expectations have meant that a number of 3M customers have chosen to integrate one of its most 
durable capacitive touch screen products, the MicroTouch near field imaging (NFI) touch screen system, into 
outdoor applications. However, there were some complaints, especially from customers in southern US states, that 
the displays to which NFI applications were mounted were turning completely black when exposed to a lot of 
sunlight. This effect is caused by liquid crystals in the LCD display becoming overheated. 


A major contributor to the problem of overheating LCDs in outdoor touch screen applications is infrared light being 
transmitted through the touch screen and heating the small space between the touch screen and the display. Because 
this space is so small (especially if there is also a dust gasket between the two parts, as is typically recommended), 
it is difficult to vent the heat once it is generated in that space. An alternative to moving heat out of the enclosed 
space is to minimize the amount of heat that 1s transmitted there. 3M engineers explored ways of reflecting as much 
heat-producing IR light as possible. IR reflecting film is not a new technology; it has been widely available for 
years. However, all [R-reflecting media consisted of very thin metallic layers. Using metallic film with capacitive 
touch screens, however, would capacitively load the system. The objective, therefore, was to find a way to reflect 
IR using a non-conductive medium without introducing unacceptable degradation of NFI touch screen optics. 


3M solar reflecting film (SRF) was invented as part of 3M research and development of several multi-layered film 
technologies. The film was first applied commercially to automobile windows with the objective of reflecting as 
much IR light as possible in order to reduce the time and energy necessary for an air conditioner to create a 
comfortable temperature in the vehicle. One of the added values was that the non-conductive film did not interfere 
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with electronic devices used in motor vehicles such as cell phones, pagers, and garage door openers. 


As shown in Figure l, when it is 
mounted to 1/8-inch clear glass, nearly 
70% of IR is reflected while only 10% | 
of visible light is reflected. So the SRF | | = Sang 
product appeared to be an answer to the | | nae 5 
objective of 3M to reflect as much heat 
producing IR as possible from 
MicroTouch NFI touch screens without 
unduly degrading optical quality. 
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All film that is exposed to light will 
eventually succumb to the yellowing 
effect of UV light. There was reason, 
however, said DeWitt, to be optimistic Visible infrared 
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original automobile application Figure 1: Transmission and reflection of light with 3M SRF film 
indicated that UV yellowing was — [gminated to 1/8-inch clear glass in accordance with ASTM E903-82, 
unlikely to be an issue during the ASTM E891-87, and WINDOW 4.1 


anticipated life of the product. Initial 

weathering tests of NFI touch screens with SRF, however, indicated a susceptibility to yellowing. The yellowing 
seemed to be due mainly to a reaction between UV light and the optical adhesive used to affix the SRF and the 
other layers in the NFI touch screen stack. The problem was solved by changing the stacking order so that the UV- 
sensitive adhesive and the SRF were protected by other layers in the stack. NFI/SRF touch screens are in use today 
in applications such as outdoor ticket kiosks, gasoline service pumps and car washes. 


The increasing access to touch screens in all sorts of places, indoors and outdoors, combined with growing alarm 
over news stories of identity and data theft has led to a requirement that touch devices in public places provide 
some protection of the privacy of users. This requirement has been met by pairing another optical film technology 
— Vikuiti light control film (LCF) — with capacitive and resistive touch screens. The 3M “micro-louver 
technology” that is built into this new product called “Privacy Film” reduces the horizontal viewing area of an LCD 
to 60 degrees (+/- 4 degrees). Only people directly in front of a touch display with Privacy Film have an 
unobstructed view of displayed information. But from either side, passers-by or casual observers see a dark, blank 
screen. The privacy film technology provides a second, equally beneficial, function of filtering ambient light and 
thereby contributing to glare reduction and contrast enhancement. 


There is the potential with Privacy Film, however, for the micro-louvers to create a twinkling effect on the display. 
This so-called “Moiré effect” (caused by microlouvers coming extremely close to the boundaries of pixels on the 
display but not quite overlapping them) was addressed by applying the privacy film at a slight bias of 2 or 3 degrees 
relative to the display. Privacy film on touch screens is expected to become standard in applications in health care, 
government, and financial markets, said DeWitt. 
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13.2: Late-News Paper: PlayAnywhere - A Compact Computer Vision-Based Tabletop Interactive Display 
Andrew D. Wilson 
Microsoft Corporation, US 


In a late-news paper, Andrew Wilson of Microsoft introduced PlayAnywhere, a front-projected computer vision- 
based interactive table system which uses a commercially available projection technology to obtain a compact, self- 
contained form factor. PlayAnywhere enables new gaming and interactive applications: it can detect the user 
touching the projection surface and track specially marked game pieces and printed pages placed on an ordinary 
desktop surface. PlayAnywhere also makes a number of contributions related to image processing techniques for 
front-projected vision-based table systems, including a shadow-based touch detection algorithm, a fast, simple 
visual bar code scheme tailored to projection-vision table systems, the ability 

“hy to continuously track sheets of paper, and an optical flow-based algorithm for 


| | the manipulation of on-screen 
J objects that does not rely on fragile 
tracking algorithms. 


Microsoft’s vision of the future of 
the device is illustrated in Figure 1. 
Here the projector and cameras, as 
| A well as computing resources such as 
| aed Ee CPU and storage, are built into the 
E same compact device. This 
combined projecting and sensing 
pod may be quickly placed on any 
flat surface, and requires no 
calibration of the projection or 
sensing system. 


Figure l: Artist’s rendition of a 
compact tabletop projection 
and sensing system. 
Artist: Young Kim 


Figure 2 shows the PlayAnywhere prototype, which includes a projector, 
camera and infrared illuminant assembled as a single piece designed to sit 
on a flat surface such as a table, desk, or floor. 


Projector: PlayAnywhere uses a NEC WT600 DLP projector to project a 
40 inch diagonal image onto an ordinary table surface. The NEC WT600 
is an unusual projector in that it uses four aspheric mirrors (no lenses) to 
project a normal 1024 x 768 rectangular image from a very oblique angle, 
and at extremely short distance. For a 40 inch diagonal image, the WT600 
requires 2.5 inch between its leading face and the projection surface, 
while a 100 inch diagonal image is obtained at a distance of 26 inches. 
These characteristics make it very well suited for Play Anywhere, in that it 
allows for the projector to sit directly on the projection surface (on a short 
pedestal), rather than hang suspended over the surface. 


Camera and illuminant: As in other projection-vision systems, 
Microsoft illuminates the scene with an infrared source and blocks all but 
infrared light to the camera with an infrared-pass filter. This effectively 
removes the projected image from the scene. By rigidly mounting the 
cameras and illuminant to the projector, the calibration of the vision 
system to the display is the same regardless of where PlayAnywhere is 
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Figure 2: PlayAnywhere 
prototype (top) consists of a 
WT600 projector on a short 

pedestal, camera with infrared 
pass filter and infrared LED 
illuminant, shown here with a 
heatsink. A circular continuous 
density filter is applied to the IR 
illuminant to eliminate hotspots 
and obtain a more uniform 
illumination of the surface. 
PlayAnywhere senses and 
projects onto a 40 inch diagonal 
area (bottom). Here four game 
pieces and a real piece of paper 
are detected 
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situated, and may be determined at the factory. PlayAnywhere uses an Opto Technology OTLH-0070-IR high 
power LED package and a Sony ExView analog grayscale CCD NTSC camera. The ExView was chosen for its 
high sensitivity in the near infrared domain. To minimize the size of the overall package, the camera is mounted 
near the top of the projector, giving an oblique view of the surface. A very wide angle micro lens (2.9 mm focal 


length) is suitable to capture the entire projected surface. 


Image rectification: In the first part of the image processing, lens distortion 
effects are removed and a projective distortion is modeled to bring the input image 
and projected image into one-to-one correspondence (i.e. a rectangular object on 
the surface appears as a rectangular object in the image at the same (scaled) 
coordinates). One limitation of this process is that, due to the oblique view of the 
camera, objects further away from the unit will appear at a lower resolution. 
Consequently, the minimum effective resolution on the surface is less than that of 
the acquired image (640 x 480 pixels). 


Touch and Hover: For PlayAnywhere, Microsoft was interested in methods to 
detect touching the surface without relying on special instrumentation of the 
surface, so that the device may operate on any available flat surface. The technique 
exploits the change in appearance of shadows as an object approaches the surface. 
Figure 3 shows the (rectified) input image with two hands in the scene. The hand 
on the left is a few inches above the surface, while the index finger of the hand on 
the right is touching the table surface. As the index finger approaches the surface, 
the image of the finger and its shadow come together, with the finger ultimately 
obscuring the shadow entirely where it is on the surface. Because the illuminant is 
fixed with respect to the camera and surface, it is possible to calculate the exact 
height of the finger over the surface if the finger and its shadow are matched to 
each other and tracked. This height could be used as a hover signal for cursor 
control, or 3D cursor control. In this particular prototype, Microsoft avoids the 
challenge of finding the finger over the table by instead performing simple 
analysis of only the shadow. Whether the finger is touching the table may be 
determined by simple analysis of the shape of the shadow. In the current 
implementation, the researchers 
simply threshold the width of the 
finger shadow computed at a 
location slightly below the 
topmost point. 





Figure 3: Finger tracking 
and touch detection is 
based on shadow shape 
analysis. The input image 
(top) shows the left hand 
above the surface and the 
right hand (index finger) 
touching the surface. The 
image is first binarized to 
recover an image which 
contains only shadows 
(bottom) 


Visual Code: For PlayAnywhere Microsoft designed a visual 





Figure 4: 3D graphics model is projected 
onto an identified game piece (left) with 
orientation determined by strong edge in 
the center of the pattern, and 12 bit code 
given by pattern around the edge (right). 
Each game piece is 1.4 inch in diameter, 
printed on a laser printer and glued to an 
acrylic plastic disc of the same diameter 


code illustrated in Figure 4, which is particularly suited to tabletop 
projection-vision systems and is simple to code. Simple local 
image processing techniques may be used to recover the 
orientation and 12 bit code associated with the pattern. 


Page Tracking: Systems such as PlayAnywhere are natural 
platforms for exploring ways to blur the boundary between the 
virtual, electronic office document and the real thing, as well as 
scenarios that exploit the natural and familiar feel of manipulating 
and drawing on paper. Microsoft has developed a real time page 
detection and tracking algorithm which permits the user to move 
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and rotate virtual objects with the same ease as manipulating a printed page on a desk (Figure 5). With this 
algorithm, multiple paper pages of known dimensions may be continuously tracked by PlayAnywhere with enough 
precision to project a virtual image on the page as it is moved around the surface. Presently multiple pages are 
tracked purely by assuming small frame to frame movement not page appearance. This tracking process also allows 





Figure 5: PlayAnywhere’s page 
tracking capability detects two 
overlapping pages placed on the 
surface (top). On the table, videos 
are projected precisely on the 
printed pages (bottom) 


In conclusion, Wilson said that one of the primary advantages of 
using a projection and vision system for interactive tables is the 
extreme flexibility afforded by computer vision processes. For 
example, with the page tracking algorithm and a generic object 
recognition algorithm it is a straightforward task to implement a 
system which recognizes which of several known audio CDs is 
placed on the table surface. Visually coded knob pieces placed on 
the surface can control volume or some other aspect of the CD’s 
playback, while a left or right gesture with the hand can cause the 
player to go to the next or previous track. 


Ultimately, the vision-based approach makes sense, says Wilson, 


for pages to be turned 180 degrees recognizably. Multiple (known) page 
sizes may also be simultaneously detected with minimal additional 
computation. Figure 5 shows page detection results and its application to 
the projection of video onto physical pages. 


Flow Move: Multiple touch interfaces such as PlayAnywhere naturally 
support a direct manipulation style of interacting with virtual objects where 
the user can initiate interacting with the object by touch and natural gesture. 
For example, in a photo browsing and sorting application, it is natural and 
convenient to move and rotate virtual photos as if they were real photos 
lying on the surface, and to support other operations that may be physically 
impossible but desirable such as resizing. With PlayAnywhere, Microsoft 
explored an approach to the simultaneous translation, scaling and rotation 
of virtual objects based on optical flow techniques that avoid traditional 
difficulties associated with tracking hands and does not rely on onscreen 
widgets (Figure 6). An onscreen object may be simultaneously rotated, 
scaled and translated in 2D by constructing the transform matrix for a 
graphics object as the composition of rotation, scaling and translation 
parameters. Because the flow-based technique does not rely on fragile, 
narrow models of detection and tracking, it supports a variety of usage 
styles. For example, it is possible to rotate an object by placing the hand on 
the object and rotating the whole hand. The same rotation can be made by 
putting two hands on either side of the object and moving them about a 
center of rotation. Scaling can similarly be accomplished by spreading or 
contracting a single hand, or by moving two hands closer or further apart. 
Subjectively, the interaction is fluid and reminiscent of a simulation of the 
physics of moving a stretchy piece of paper. 





only if the flexibility available in this approach is used. This in turn Figure 6: Flow field-based manipulation 
depends on the various applications that Microsoft dreams up — if of objects applied to panning, rotating, 
the only intention is to emulate the single cursor in Windows on a and zooming a high-resolution map 
table, the computer vision approach is probably unnecessarily 

complex and inferior in many respects, he stressed. 
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Technology Showcase 


Tokyo University produces Khronos Projector for movie manipulation 


Researchers at the University of Tokyo have come up with the “Khronos Projector” an interactive-art installation 
allowing people to explore pre-recorded movie content in an entirely new way. By touching the projection screen, 
the user is able to send parts of the image forward or backwards in time. 


Project leader Alvaro Cassinelli says, “By actually touching a deformable projection screen, shaking it or curling it, 
separate ‘islands of time’ as well as ‘temporal waves’ are created within the visible frame. This is done by 
interactively reshaping a two-dimensional spatio-temporal surface that ‘cuts’ the spatio-temporal volume of data 
generated by a movie.” 


The deformable screen is made from a 
thin, translucent elastic fabric such 
as spandex-based fibers - better 
known as Lycra. There are several 
ways to scan this surface in order 
to extract its depth characteristics, 
says Cassinelli. A rather 
conventional technique would rely 
on a 2D scanning rangefinder. 
After giving the problem some 
thought, Cassinelli decided to study a 
cheaper technique not relying on 
any laser scanner. A conventional 
CCD camera and a Special 
illumination configuration would 
suffice, he concluded. Using an 
on-axis infrared source (such as an 
LED ring) and a Conventional CCD camera (with an IR filter), it is possible to acquire a gray-scale image 
indicating, at each location on the surface, the actual inclination between the illuminating ray and the surface- 
normal; if both the camera and the light source are relatively far from the screen, and placed so as to share the same 
optical axis (see figure), then it is relatively easy to compute the actual deformation of the screen from the gray- 
scale map data. 





To enhance infrared reflectivity and diminish the rear-projector “hot spot’, the soandex-based fabric is 
plastic coated on the inner side. Although this deformable screen was first conceived as a dedicated 
pressure-sensitive and deformable screen for the Khronos projector, it may represent an interesting 
human-computer interface for defining and visualizing arbitrarily-shaped slices of volumetric data Such as 
medical body scanner images, says Cassinelli. In particular, it can be a starting point for developing a 
pre-operatory interface capable of showing inner body sections mapped onto complex surfaces, just as 
they would appear to the surgeon during an actual operation. 


Videos and demonstrations can be viewed at 
www.k2.t.u-tokyo.ac.jp/members/alvaro/Khronos/Khronos_Projector.htm 
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Palm rejection on resistive touchscreens 


by Geoff Walker 


Have you ever used a device such as a webpad and had the cursor jump around or disappear under your hand as you 
tried to write something on the screen? If so, you’ve experienced a lack of palm rejection. 


Palm rejection allows a user to rest their hand or other object on a touchscreen without activating it. Palm rejection 
is usually significant only in devices with screens larger than about four inches, since with smaller screens the 
user’s hand rests mostly on the screen bezel. It’s also usually significant only in devices that are intended to be 
used with a pen or stylus, since if a device is meant to be used only with pure finger-touch, there’s no reason for the 
user to rest their hand on the screen. 


Palm rejection isn’t really about your palm; it’s about the part of your hand that pokes the writing surface when you 
hold a pen. For some people, it’s the skin protrusion resulting from the creases on the edge of your hand; for 
others, it’s the knuckles on your little finger. Both of these are relatively sharp points that act like a finger-touch. 
Resistive touchscreens can’t handle multiple touches, so the cursor goes somewhere other than where it should be. 


How common is poor palm rejection? Unfortunately, it’s very common. It seems as though almost every pen 
tablet created in the last five years has had poor palm rejection (Tablet PCs don’t count, since they use active 
electromagnetic digitizers rather than touchscreens). Hardware OEMs just don’t seem to think about this issue 
during design, and the touchscreen vendors contribute by minimizing the issue or appearing uninterested in doing 
the required customization. 


Poor palm rejection can kill a product. Here’s an example from my consulting experience. A few years ago a large 
hardware OEM bought into the Microsoft hype and created a very nice “Smart Display” (originally known as a 
“Mira” device). Unfortunately, since Microsoft’ s basic concept was seriously flawed, the product didn’t sell very 
well. The OEM tried re-purposing the product as a vertical-market data collection tablet (1.e., a wireless thin 
client), at which point they discovered that none of their enterprise prospects were willing to buy the device. 
Prospects found that having to hold their hand above the screen while using the product (due to lack of palm 
rejection) was just too uncomfortable to tolerate for any length of time. That OEM’s Smart Display is still a 
product in search of a market. 


How Palm Rejection Works: Figure 1 shows the basic components of a typical resistive touchscreen. A 
touchscreen contains two layers of transparent conductor (ITO, indium tin oxide), one on top of the glass substrate 
and one on the underside of the PET (polyethylene terephthalate) top layer. The two layers are kept apart by 
transparent spacer dots. When a finger or pen 
presses on the top surface, the transparent 
conductors make contact and the touchscreen 
controller determines the touch position. 







Finger or per 
ff FET film 

The key to palm rejection on a resistive ; 
touchscreen is the spacing of the spacer dots. 
Most touchscreen vendors use spacing (pitch) of 
around 3.5 mm and a dot size of around 0.1 mm. = : 
This is a compromise that allows the touchscreen +— Glass substrate 
to work both with large, blunt objects such as a 
finger and with small, sharp objects such as a pen. 
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# iTO layer 
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Figure 1: Basic components of a typical resistive touchscreen 
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In fact, almost all standard resistive touchscreens are marketed as being able to work with “finger, fingernail, 
gloved hand, pen or stylus”. This positioning in itself is a warning that most standard resistive touchscreens don’t 
include palm rejection. 


If the spacer dots are far apart, pressure from either a large-radius object or a small-radius object can cause the 
conductors to touch. If the spacer dots are close together, only a small-radius object can cause the conductors to 
touch, since a large-radius object covers too many spacer dots. Of course, if the user exerts enough pressure, any 
size object can cause the conductors to touch. 


The definition of a “small-radius object” is fairly consistent among the eight well-known touchscreen vendors 
shown in Table 1 — it’s usually a rigid pen tip of diameter 1.6 or 2.0 mm. Touch International is the only oddball at 
0.8 mm diameter, and their spec is probably a typo. The definition of a “large-radius object” varies a bit more by 
vendor. It’s usually a silicone rubber hemisphere, ranging in diameter from a low of 6 mm (Gunze) to a high of 25 
mm (SMK). If you press your index finger to one side of a piece of glass and measure the flattened area on the 
other side, you’ll probably find that it’s around 15 mm in diameter, so the 16.3 mm average in Table 1 is about 
right. Why is this spec important? A touchscreen that’s properly designed for a 6 mm finger should have better 
inherent palm rejection than a touchscreen designed for a 25 mm finger because the spacer dots in the former 
should be closer together. 


Touchscreen Standard Spacer Pen Finger 
www.bergquistcompany.com 


Yes | Yes www fujitsu.com 
a ae 


| average [6mm | 163mm 





Table 1: Palm-rejection related specifications from eight touchscreen vendors 
(Data taken from vendor websites on 11/25/05) 


Designing for Palm Rejection: If you’re designing a product that uses a resistive touchscreen and you want palm 
rejection, it’s almost always necessary to specify a custom touchscreen. Only one of the vendors shown in Table 1 
(Fujitsu) offers a standard “pen-only” (palmrejecting) touchscreen. Fujitsu and 3M both offer the ability to 
customize the spacer dots; Bergquist implies that they offer the ability without making it an explicit option. None 
of the other vendors acknowledge the issue of palm rejection in their published specifications. 


One of the unfortunate side effects of using a pen on a resistive touchscreen is that it shortens the life of the 
touchscreen. Lifetime (durability) specs for four-wire touchscreens are typically 1M finger touches or 100K pen 
touches; for five-wire touchscreens they’re typically 35M finger touches or 1M pen touches. This becomes a 
serious consideration when you’re designing a penmcentric product, since in a real-world POS application, 100K 
touches takes only a few months. There are two aspects to the shortened life — cosmetic and electrical. In the 
former, the pen causes the top surface of the PET to become cloudy due to mechanical abrasion. This can be 
eliminated by using a “screen protector” (a replaceable plastic film) on top of the touchscreen. Electrical end-of- 
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life is usually caused by failure of the ITO coating; the pen contributes to this by causing the ITO-coated PET to 
flex at a sharper radius than the gentler radius produced by a finger. 


Fixing Poor Palm Rejection: Can palm rejection be added to a finished product? Not really. The right solution is 
to replace the touchscreen with one that has closer spacer dots. Unfortunately, real-world supply chain 
considerations often make this impractical once a product is in production. It’s theoretically possible to write a 
smart touchscreen driver that provides palm rejection while you’re writing by filtering points both spatially and 
temporally. However, what if the application is primarily composed of checkboxes, pull-down menus and other 
such non-handwriting UI elements? From the driver’s point of view, the user seems to be tapping randomly all 
over the screen, and the filtering algorithm falls apart. If the driver attempts to filter just the specific active areas on 
each application screen (a bad idea from an abstraction point of view), the user’s hand can still be resting on one 
active area while he’s tapping another. Most attempts to fix poor palm rejection after the fact have an adverse 
impact on the user’s interaction with the system (e.g., the system doesn’t respond when you tap outside of an active 
area, or it responds in ways that make sense to the driver but not to the user). 


The best approach is to fully understand the requirements of an application before designing a product for it, and to 
work closely with a touchscreen vendor to customize the touchscreen appropriately when palm rejection is 
required. 


Based in Silicon Valley, Geoff Walker is a consultant with Walker Mobile, LLC (www.walkermobile.com). Geoff has 
worked on the engineering and marketing of mobile computers since 1982 at GRiD Systems, Fujitsu Personal Systems 
(now Fujitsu Computer Systems) and Handspring. In addition to mobile computers, Geoff’s areas of particular 
expertise include displays and digitizers. 


Parting Shot... 





Hutto, Texas-based Touchsystems suggests that touchscreen technologies are both 
intuitive to use and quickly becoming commonplace in our everyday lives... 
Image is from their website. 


33 


Veritas et Visus Touch Panel November 2005 


Displays Industry Calendar 


For a more complete listing of events in the displays industry, visit the Calendar Section at www.veritasetvisus. 
We work hard to sustain a very comprehensive listing of display-related events. If you would like to submit 
information about an event, please send to either mark @ veritasetvisus.com or phill @ veritasetvisus.com. 





December 2005 


Decemberi Projection Displays and Systems - “An Update on Newport Pagnell, Ukcin 
Trends and Technologies” England -e = 
December 56 Digital Living Room Foster City, California DIGITAL LIVING ROON 
briny ing aii dare reel into tha beara 
December 5-7 Standardization: Unifier or Divider? STANDARDIZATION 
December 6-9 12th International Display Workshops Takamatsu, J apan B | oii OS B 
December 6-9 Digital Video Expo West Las Angeles, California Had A' 
December 7-8 Printed Electronics USA 2005 Naples, Florida DTechEx Ex 
December 12-15 International Conference on Optics and Dehradun- India 
Optoelectronics 
December 12-16 Optics for Displays Cambridge, England | 


va. ARGH 


J anuary 2006 






















J anuary 4 HDTV Business Conference Las Vegas, Nevada 


J anuary 4-6 Game Power Showcase and Forum Las Vegas, Nevada 


J anuary 5-8 2006 International CES Las Vegas, Nevada 


va. 
J anuary 9-13 Liquid Crystal Displays Oxford, England Oxford, England | 


J anuary 9-13 MacWorld Expo San Francisco, California Macworl 
Comference & Expo’ 


J anuary 11-12 Metalization and Patterning of Solid and Flexible Bletchley Park, England = uUkdMm 
Substrates . 
J anuary 13 LEDs in Displays Technical Symposium Costa Mesa, California s D 
J anuary 15-19 Electronic Imaging 2005 San J ose, California ia nic 
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Stereoscopic 
J anuary 15-19 Stereoscopic Displays and Applications San J ose, California 
J anuary 21-26 Photonics West 2006 San J ose, California orl lie eri aria 


J anuary 23-25 electroniclIndia New Delhi, India à "i 
i 
J anuary 24-26 ATEI 2006 London, England E \ | a 


February 2006 


February 1-2 Screen Expo Europe London, England  Blegsa AL m 
February 1-3 Integrated Systems Europe 06 Brussels, Belgium | 


FI le Mi lect Displ ar 
Februay 6d exible Microelectronics and Displays Poan Ano 0 
Conference ‘ 
February 7-9 Video Forum Europe London, England = | se ool A o 
3j i ys | 


Cronos [| smorem | e | semi 
a 


February 16-17 Electronic Information Displays (EID) Technology Birmingham, England 
Show 
February 24-26 | 24 February 24-26 | Sound & Vision 2006 Bristol, England naras 


February 27 - 
Global FPD Partners Okinawa,J apan Las emil 
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